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(57) ABSTRACT 

An iterative decoder and decoding method for decoding a 
binary block code defined by a parity check matrix. The 
parity matrix is processed several times row-by-row so that 
each iteration of the decoding corresponds to the decoding 
of the code defined by a row of the matrix for received data. 
For decoding an extended code, each row defines two 
separate codes which are decoded with each iteration. 
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ITERATIVE DECODING FOR BINARY 
BLOCK CODES 

CROSS-REFERENCE TO RELATED 
APPLICATIONS 

Not Applicable 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

Not Applicable 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The invention relates to a digital transmission system 
comprising at a transmitting end data coding means based on 
a binary block code defined by a parity check matrix, and at 
a receiving end decoding means for making decisions on 
received data. 

The invention also relates to a method of decoding 
previously coded data based on a binary block code defined 
by a parity check matrix and a decoder for decoding previ- 
ously coded data based on the binary block code defined by 
a parity check matrix. 

The invention has important applications, notably in the 
field of digital data transmission. 

2. Description of Related Art 

The article "A Class of Algorithms for Decoding Block 
Codes with Channel Measurement Information", written by 
David Chase and published in IEEE Transactions on Infor- 
mation Theory, Vol. IT- 18, no. 1, January 1972, describes a 
method of decoding binary block codes. 

SUMMARY OF THE INVENTION 

It is an object of the invention to propose a much simpler 
method which enables to obtain a performance of the same 
order. 

For this purpose, a digital transmission system according 
to the invention and as described in the opening paragraph 
is characterized in that said decoding means are iterative 
decoding means, each iteration corresponding to the 
decoding, for received data, of the code or codes defined by 
a row of the matrix. 

Similarly, a decoding method according to the invention 
and as described in the opening paragraph is characterized in 
that said method is an iterative decoding method which 
comprises for each iteration a decoding step, for received 
data, of the code or codes defined by a row of the matrix. 

And a decoder according to the invention and as described 
in the opening paragraph is characterized in that it comprises 
iterative decoding means, each iteration corresponding to 
the decoding, for received data, of the code or codes defined 
by a row of the matrix. 

When said binary block code is an extended code, each 
row of the matrix defines two separate codes and, 
advantageously, said iterative decoding means comprise 
means for processing each of the two codes in parallel. 

Finally, in an advantageous embodiment of the invention, 
said decoding means comprise for the processing of certain 
iterations at least: 

calculating means for calculating, based on input data, 
reliability data relating to soft decisions, 

transforming means for calculating transformed data 
based on said soft decisions so as to normalize the mean 
value of said reliability data, 
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weighting means for calculating weighted sums of said 
transformed data and received data with a first and a 
second weight factor, respectively, 

generating means for generating subsequent input data to 
5 be re-inserted for the next iteration on the basis of said 
weighted sums. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 These and other aspects of the invention are apparent 
from and will be elucidated with reference to the embodi- 
ments described hereinafter. 
In the drawings: 

FIG. 1 diagrammatically shows a transmission system 
15 according to the invention, 

FIG. 2 represents the various steps of a decoding method 
according to the invention, 
FIG. 3 is a detailed representation of one of the steps of 
2Q the decoding method shown in FIG. 2, 

FIG. 4 is a block diagram of a decoder according to the 
invention, 

FIGS. 5 and 6 are more detailed representations of certain 
blocks of FIG. 4, 

25 FIG. 7 is a block diagram of a decoder for a two- 
dimension product code of which each of the codes is an 
extended Hamming code, and 

FIG. 8 is a block diagram of a decoder 300 for a 
two-dimension product code. 

30 

DESCRIPTION OF PREFERRED 
EMBODIMENTS 

In the following description reference is made to an 

35 extended binary block code. For more details about this type 
of code the reader is referred to, for example, the book by 
Arnold M. Michelson and Allen H. Levesque entitled "Error 
control techniques for digital communications", published in 
the Wiley Intersciences Editions in 1985. 

40 The code used is a code of length N and dimension K. 
Thus, as indicated in FIG. 1, data to be protected coming 
from a source 2 is divided into words of Kbits [I 0 , . . . , !*_.,] 
which are processed by coding means 3. These coding 
means generate for each information word a code word of N 

45 bits [b 0 , . . . , b^J. The number of redundancy bits of the 
code is thus (N-K). Modulation means 8 assign the code 
words produced on the output of the coding means 3 to 
symbols of a constellation. These symbols are transmitted 
over a channel 9. In the example described here, the con- 

50 ste llation used is a QPSK constellation, so that decoding 
consists of making a decision between two possible values 
(+1 and -1) for each symbol received in the quadrature and 
the in-phase channel. 

55 The invention can be applied to other types of 
constellation, notably to a BPSK constellation. 

At the receiving end, the received data 10 are processed 
by customary demodulation means 11. The real symbols 
[r 0 (0) , . . . , r^./^] produced on the output of the deraodu- 

60 lation means 11 are applied to iterative decoding means 20 
which deliver an estimation [6 0 , . . . , d^-i] of the code word 
that has been transmitted. These N estimation bits are then 
transmitted to extraction means 21 which deliver an estima- 
tion [1 0 , • • • , I/c-i] of the transmitted data word. 

65 Let H-[hyJ be the parity check matrix that defines the 
code used. This matrix is a matrix having dimension 
(N-K).N whose elements h,, have a 0 or 1 -value. 
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The matrix enables to define a first series (1) of parity 
check equations: 

/tt r -[0] (1) 

where b T is the column vector formed by the transpose of the 5 
code word [b 0 , . . . , b^.J. The equations (1) may also be 
written for j=0, . . . , N-K-l as: 



10 



or also: 



J> = 0 



15 



where Z designates the modulo-2 sum and S y - is the set of 
indices lying between {0, . . . , N-l}, so that h ; -,-l. Each of 20 
these equations can be regarded as a simple parity code 
denoted Cy applied to the word [b 0 , . . . , b^J. 

When the code used is an extended code, the overall 
parity of the bits of the code word is satisfied as a result, the 
last row of the matrix (j=N-K-l) is a row of 1). The relation 25 
(2) is thus also verified: 

b<@b l &bj® . . . ©/v_,=o (2) 

(the sign © indicates the modulo-2 sum). 

In this case, the matrix H defines a second series of 30 
equations (3) for j=0, . . . , N-l which are derived from the 
relations (1) and (2): 



The first iteration (1=0) is applied to symbols received 
from the channel [r 0 <°<>, . . . , r^/^]. In a general way, the 
iteration j is applied to a block of input data [r 0 w , . . . , r^.-, 0 ] 
and it produces, after decoding the codes C 0>u>d(mX and 
Ctjimodtmy a block of soft decisions [r' 0 « . . . , r'„_ «]. In 
an advantageous embodiment of the invention, another 
block [r" 0 w , . . . , rVi W ] ^ derived from this block of soft 
decisions. This other block constitutes the block of subse- 
quent input data for the next iteration fi+l), so that 

[r 0 ° +1) r„_^MrV°,...,rV>]- 

This decoding method is summarized in FIG. 2. It com- 
prises the following steps for each iteration j: 

step 110: subdivision of the block of input data 
[ro^, . . . , into two groups, the one correspond- 

ing to the indices lying in S^ m ^ (w?) , and the other 
corresponding to indices lying in S^^^. 

step 120: decoding of C (fjmodf ^ and C' 0>no</(m) applied to 
[ r i > ieS (,)morf ( m)] to [r/» icS^^], respectively. 

step 130: normalization of the soft decisions t'W; 



35 



where S y - is the set of indices lying between {0, . . . , N-l}, 
so that hj~G. Just like the relations (1), each of these 
equations can be regarded as a simple parity code denoted 40 
Cy applied to the word [b 0 , . . . , b Nmml ], 

According to the invention, the decoding is an iterative 
decoding. The principle of iterative decoding (or turbo 
decoding) was explained at the conference "Near Shannon 
error correcting coding and decoding: turbo codes" by A. 45 
Glavieux et al., IEEE IC-93, pp. 1064-1071, May 1993, for 
the decoding of concatenated codes. It consists of approach- 
ing an optimum decoding by effecting Q iterations of a 
non-optimum decoding. The Q-l** first iterations consist of 
generating a soft decision equal to the product of a reliability 50 
data about a received symbol and of the decision called hard 
decision made about this symbol, and inserting this soft 
decision into the input of the decoding means for the next 
iteration. The last iteration produces a hard decision. 

The invention notably consists of applying this decoding 55 
principle to a binary block code. Therefore, each iteration j 
consists of decoding the code C 0>oJ(m) , or advantageously 
the codes C WW(m) and C'^^^ in parallel when the code 
is an extended code (when m-N-K-1 is the index of the last 
but one row of the matrix H.) In other words, the parity 60 
check matrix is processed row-by-row various times so that, 
for received symbols r,- <0) , each iterative decoding iteration 
corresponds to the decoding of the code C Wwiarf(m) or codes 
Cpmodim) and C r 0> ^ (m) defined by the row (j) modulo-(m) 
of the matrix. 65 

In the following description, the code is considered to be 
an extended code. 



Pmj»/p With fl =42H*| 
i=0 



This normalization enables to take into account that the 
data t^ are theoretically distributed around the values 
+1 and -1 in accordance with a Gaussian distribution, 
step 140: weighting of the data t/° with the symbols 
received from the channel r/ 0) : f^-Y^t^+p^r/ 05 
where and fi^ are the first and second weight 
factors. In an advantageous way, there is selected 
Po:i ol -Y(rt and Y(o)-0-5, Ycd-0-7, Y C 2)=0.9 and 
Thus, by reducing the weight of the received symbols 
in accordance with the iterations, the risk is taken into 
account that the divergence diminishes with the number 
of iterations, whereas the error correction increases. At 
the end of the step 140, the method is resumed at step 
110. 

FIG. 3 shows the second step 120 in detail. This step 
combines the steps following 120 up to 126 for each of the 
two decodings C 0><?</(m) and C (i y maKm y 
step 121: calculation of the parities p and p of the symbols 
r/° to which the decoding is applied (that is, symbols 
ieSo>«*(J for the decoding of and 
symbols of [r/", ieS^,^^] for the decoding of 
^qynodimy an d searches in each of its two symbol sets 
r/" for the less reliable, that is to say, the one nearer to 
zero (these symbo ls are called first minimums and 
denoted MINI and MINI, respectively): 
initialization: p»0, MINl»oo and MINl«oo 

for ieS^w,^) „ 

calculation of b i -sgn(r I w , with sgn(x)-0 if x>0 and 1 if 
not 

calculation of p-p©b, 

if MINl>|r,«| then MINl-|r, w | and iMINl-i 

and for ieS mmt>d( ^, 

calculation of b t «sgn(r^), with sgn(x)=0 if x>0 and 1 
if not 

ca lculati on of p°pSb, 

if MINT>|r, w | then MlRT«|r f w | and IMINToO 
step 123: in each of the two sets, correction of the less 
reliable symbol and calculation of a sign indicator 
denoted inv and mv, respectively: 
biMim-piMrm®P andmv-l-2p 
bnarar- b; M M l O p and inv-l-2p: 
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step 124: test j=Q-l (where Q is the total number of 
iterations necessary for approaching the optimum 
decoding). If j»Q-l, the decoding is terminated, which 
is symbolized in FIG. 3 by an arrow 129 to a box 170 
at the end of the method. The hard decisions are formed 
by the block b/i-0, . . . , N-l). If j*Q-l, the iteration 
carries on with the next steps 125, 126 and 127. 

step 125: search for the second minimum denoted MIN2: 
initialization: MIN2»a>, and MIN2=oo 
for icS^^ and i*iMINl, if MIN2>|r,^L then 
MIN2-|r/0| 

and for i€S 0><wf(m) and wiMINl, if MIN2>|r/°|, then 
MINI-Irfl 

step 126: calculation of tlie reliability f/^ and of the soft 
decision r'/^: 

for icS 0W(m) and i*iMINl, f »-[|r, w |+inv.MINl] 

for i«iMINl, f w/M «-MIN2+inv.MINl 

for ie S mworfr wrt et i*i MINl, f P-[ |r/fl|+in v.MINl] 
for i-iMINl, fg^ 0 ^MlN2+inv. MINI 
step 127: for any i varying from 0 to N-l, 

r^l-2b f ).f. w 
This reliability calculation is a conventional calculation of 
which the principle is recalled, for example, in the article 
"Efficient so ft- in-soft-out sub -optimal decoding rule for 
single parity check codes*' published in ELECTRONICS 
LETTERS of Sep. 11, 1997 (Vol. 33, no. 19). 

In practice, it has been found that a number q of iterations 
of the order of 2m enables to converge to the optimum 
decoding. 

In FIG. 4 are represented the results obtained (packet error 
rate PER as a function of the signal-to-noise ratio SNR 
expressed in dB in accordance with iterations for an 
extended Hamming code H (16,11) (that is, for N=16, K=ll 
and m=4). 

The curves obtained show that one converges to the 
optimum decoding from the 1 th iteration onwards (in the 
FIGURE, the optimum decoding is represented by an unbro- 
ken line without a symbol). 

It will be noted that the invention which is applicable to 
any binary block code gives particularly interesting results 
in the particular case where this code is a Hamming code. 

In FIG. 5 is shown by way of a block diagram an example 
of embodiment of decoding means 20 according to the 
invention. They comprise a memory 201 in which are stored 
the symbols received from the channel [r 0 (0) , . . . , r^^ 05 ] 
and the weighted sums [r" 0 ^, . . . , r" JV _ 1 w ] produced with 
each iteration j in the form of a second recording. Each block 
[r 0 w , . . . , read from the memory 201 is applied to 

the input of a router 202 which addresses the input data 
corresponding to the Q-l'* first iterations (j-0 to Q-2) to 
decoding means 203 which produce the weighted sums 
[r'^, . . . , r'V-a^] stored in the memory 201, and the input 
data corresponding to the Q th iteration (j-Q-1) to decoding 
means 204 which produce hard decisions [b 0 , . . . , b^J 
which are transmitted to the extraction means 21. 

In FIG. 6 are shown in detail in the form of a block 
diagram decoding means 203. They comprise a demulti- 
plexer 230 which receives, coming from a router 202, the 
input data [r o 0 , . . . , r^.^] for the j* iteration. This 
demultiplexer 230 applies the data [r/^, icS^ mod(m ^] to first 
decoding means_231 for decoding the code C 0>W(m) , and 
the data [r f w , ieS 0 ^ ma</(m) ] to second decoding means 232 for 
decoding the code C' Wmo ^ (/n) . At the output of the first 
decoding means 231 are obtained the soft decisions [r*, w , 
ieS(Omed(»o] and at tne output of the second_decoding means 
232 are obtained the soft decisions [tp\ ieS^ mo</(m) ]. These 
soft decisions are applied to the input of normalization 
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means 233. These normalization means 233 produce data iff* 
which are applied to weighting means 234. The weighting 
means 234 further receive, coming from the memory 201, 
the symbols r/ 0) which have been received from the channel. 
5 They produce data r"/ 0 which form the subsequent input 
data r V V1) for the next iteration and which are stored in the 
memory 201. 

FIG. 7 shows in detail the decoding means 204 in the form 
of a block diagram. Similarly to the coding means 203, they 
comprise a demultiplexer 240 which receives, coming from 

the router 202, input data [r ? (CM) , r^^] for the 

iteration Q-l. This demultiplexer 240 applies the data 
[r/e - ^, ieS( Q _ 1>nod ^] to first decoding means 241 for 
decoding the code CLi^d^), and the data [r/ G_1) , ie 
S(Q-i)m<^(m)] to second decoding means 242 for decoding 

15 the code C' (G _ 1)morf(m) . At the output of the first coding 
means 241 are obtained the hard decisions [b t , 
ieS ((2 _ 1)mod ,, m) ], and at the output of the second decoding 
means 242 are obtained the hard decisions [b,-, ie 
S(G-:i >»«/(/»)]• These hard decisions are applied to the extrac- 

20 tion means 21. 

In another embodiment of the invention, the last iteration 
j=Q-l produces a block of soft decisions (or of weighted 
sums obtained on the basis of these soft decisions). This 
embodiment enables to implement the decoding method that 

25 has just been described for decoding a product code for 
which at least one of the codes used is a binary block code 
(a code that may be represented by a matrix of various 
dimensions of which each dimension gives a code word 
while the codes used for each dimension may be different is 

30 called a product code). For decoding a product code, an 
iterative decoding is used in known fashion which consists 
of alternating a decoding of the matrix with each of its 
dimensions several times. For each of these decodings, soft 
decisions are to be available on the input, whence the 

35 necessity to produce a soft decision for the last iteration on 
the output of the decoding means according to the invention. 

FIG. 8 diagrammatically represents an example of a 
decoder 300 for a two-dimension product code, of which 
each of the codes is an extended binary block code. This 

40 decoder 300 comprises first decoding means 400 for per- 
forming a matrix row decoding and second decoding means 
500 for performing a matrix column decoding. These decod- 
ing means 400 and 500 are similar to those that have just 
been described, but produce soft decisions at the last itera- 

45 tion (with the exception of the last iteration of the decoding 
means 500, for the last iteration of the decoder 300). 

In another embodiment, shown in the diagram by dashed 
arrows 600 in FIG. 8, the performance is further improved 
by weighting the soft decisions of the matrices produced on 

50 the output of the decoding means 400 and 500 with the 
symbols received from the channel. 

The invention is not restricted to the embodiment that has 
just been described by way of example. More particularly, 
the normalization step 130 and weighting step 140 or one of 

55 these steps could be omitted, which would lead to a drop of 
the system performance. 
What is claimed is: 

1. Adigital transmission system comprising a transmitting 
end data coding means (3) based on a binary block code 

60 defined by a parity check matrix, and at a receiving end 
decoding means (20) for making decisions on received data 
(10), characterized in that said decoding means are iterative 
decoding means, each iteration corresponding to the 
decoding, for received data, of the code or codes defined by 

65 a row of the matrix. 

2. A digital transmission system as claimed in claim 1, 
characterized in that, when said binary block code is an 
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extended code, each row of the matrix defines two separate 
cod es (Cy^^ and C (f>nm/(m X and said iterative decoding 
means (20) comprise means (231 and 232) for processing 
each of the two codes in parallel. 

3. A digital transmission system as claimed in claim 1, 
characterized in that said decoding means comprise for the 
processing of certain iterations at least: 

calculating means for calculating, based on input data 
(r/°), reliability data relating to soft decisions 

m 

transforming means for calculating transformed data (t/^) 
based on said soft decisions so as to normalize the mean 
value of said reliability data, 

weighting means for calculating weighted sums (r^®) of 
said transformed data and received data (r, w ) with a 
first (a 0) ) and a second (c^) weight factor, 
respectively, 

generating means for generating subsequent input data 
(r/**^) to be re-inserted for the next iteration on the 
basis of said weighted sums. 

4. A digital transmission system as claimed in claim 2, 
characterized in that said decoding means comprise for the 
processing of certain iterations at least: 

calculating means for calculating, based on input data 
(ri(j)), reliability data (fi(j)) relating to soft decisions 

transforming means for calculating transformed data (ti 
(j)) based on said soft decisions so as to normalize the 
mean value of said reliability data, 

weighting means for calculating weighted sums (r H i(j)) of 
said transformed data and received data (ri(0)) with a 
first (a(j)) and a second (6(j)) weight factor, 
respectively, 

generating means for generating subsequent input data 
(ri(j+l)) to be re-inserted for the next iteration on the 
basis of said weighted sums. 

5. A method of decoding data previously coded based on 
a binary block code defined by a parity check matrix, 
characterized in that said method is an iterative decoding 
method which comprises for each iteration a decoding step 
(120), for received data, of the code or codes defined by a 
row of the matrix. 

6. A data decoding method as claimed in claim 5, char- 
acterized in that, when said binary block code is an extended 
code, each row of the matrix defines two separate codes 
(C(,W(m) and C (f)mod^> and said decoding method pro- 
cesses each of the two codes in parallel. 

7. A data decoding method as claimed in claim 5, char- 
acterized in that said decoding step comprises for the 
processing of certain iterations at least: 

a calculation step (126) for calculating, based on input 

data, reliability data relating to soft decisions, 
a transforming step (130) for calculating transformed data 

based on said soft decisions so as to normalize the mean 

value of said reliability data, 
a weighting step (140) for calculating weighted sums of 

said transformed data and received data with a first and 

a second weight factor, respectively, 
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a generation step for generating subsequent input data 
magnitudes to be re-inserted for the next iteration on 
the basis of said weighted sums. 

8. A data decoding method as claimed in claim 6, char- 
acterized in that said decoding step comprises for the 
processing of certain iterations at least: 

a calculation step (126) for calculating, based on input 

data, reliability data relating to soft decisions, 
a transforming step (130) for calculating transformed data 

based on said soft decisions so as to normalize the mean 

value of said reliability data, 
a weighting step (140) for calculating weighted sums of 

said transformed data and received data with a first and 

a second weight factor, respectively, 
a generation step for generating subsequent input data 

magnitudes to be re- inserted for the next iteration on 

the basis of said weighted sums. 

9. A decoder of data previously coded on the basis of a 
binary block code defined by a parity check matrix, char- 
acterized in that it comprises an iterative decoding means 
(20), each iteration corresponding to the decoding, for 
received data, of the code or codes defined by a row of the 
matrix. 

10. A decoder as claimed in claim 9, characterized in that, 
when said binary block code is an extended code, each row 
of the matrix defines two separate codes (C Wmotf(m) and 
C(/)mo<i(m))f and sa id decoding method processes each of the 
two codes in parallel. 

11. A decoder as claimed in claim 10, characterized in that 
said decoding means comprise for processing certain itera- 
tions at least: 

calculating means for calculating, based on input data, 

reliability data relating to soft decisions, 
transforming means for calculating transformed data 

based on said soft decisions so as to normalize the mean 

value of said reliability data, 
weighting means for calculating weighted sums of said 

transformed data and received data with a first and a 

second weight factor, respectively, 
generating means for generating subsequent input data to 

be re-inserted for the next iteration on the basis of said 

weighted sums. 

12. A decoder as claimed in claim 9, characterized in that 
said decoding means comprise for processing certain itera- 
tions at least: 

calculating means for calculating, based on input data, 

reliability data relating to soft decisions, 
transforming means for calculating transformed data 

based on said soft decisions so as to normalize the mean 

value of said reliability data, 
weighting means for calculating weighted sums of said 

transformed data and received data with a first and a 

second weight factor, respectively, 
generating means for generating subsequent input data to 

be re-inserted for the next iteration on the basis of said 

weighted sums. 
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